Salient Object Detection in RGB-D Videos

Given the widespread adoption of depth-sensing acquisition devices, RGB-D videos and related data/media have gained considerable traction in various aspects of daily life. Consequently, conducting salient object detection (SOD) in RGB-D videos presents a highly promising and evolving avenue. Despite the potential of this area, SOD in RGB-D videos remains somewhat under-explored, with RGB-D SOD and video SOD (VSOD) traditionally studied in isolation. To explore this emerging field, this paper makes two primary contributions: the dataset and the model. On one front, we construct the RDVS dataset, a new RGB-D VSOD dataset with realistic depth and characterized by its diversity of scenes and rigorous frame-by-frame annotations. We validate the dataset through comprehensive attribute and object-oriented analyses, and provide training and testing splits. Moreover, we introduce DCTNet+, a three-stream network tailored for RGB-D VSOD, with an emphasis on RGB modality and treats depth and optical flow as auxiliary modalities. In pursuit of effective feature enhancement, refinement, and fusion for precise final prediction, we propose two modules: the multi-modal attention module (MAM) and the refinement fusion module (RFM). To enhance interaction and fusion within RFM, we design a universal interaction module (UIM) and then integrate holistic multi-modal attentive paths (HMAPs) for refining multi-modal low-level features before reaching RFMs. Comprehensive experiments, conducted on pseudo RGB-D video datasets alongside our RDVS, highlight the superiority of DCTNet+ over 17 VSOD models and 14 RGB-D SOD models. Ablation experiments were performed on both pseudo and realistic RGB-D video datasets to demonstrate the advantages of individual modules as well as the necessity of introducing realistic depth. Our code together with RDVS dataset will be available at https://github.com/kerenfu/RDVS/

Markovian Dynamics on Complex Reaction Networks

Complex networks, comprised of individual elements that interact with each other through reaction channels, are ubiquitous across many scientific and engineering disciplines. Examples include biochemical, pharmacokinetic, epidemiological, ecological, social, neural, and multi-agent networks. A common approach to modeling such networks is by a master equation that governs the dynamic evolution of the joint probability mass function of the underling population process and naturally leads to Markovian dynamics for such process. Due however to the nonlinear nature of most reactions, the computation and analysis of the resulting stochastic population dynamics is a difficult task. This review article provides a coherent and comprehensive coverage of recently developed approaches and methods to tackle this problem. After reviewing a general framework for modeling Markovian reaction networks and giving specific examples, the authors present numerical and computational techniques capable of evaluating or approximating the solution of the master equation, discuss a recently developed approach for studying the stationary behavior of Markovian reaction networks using a potential energy landscape perspective, and provide an introduction to the emerging theory of thermodynamic analysis of such networks. Three representative problems of opinion formation, transcription regulation, and neural network dynamics are used as illustrative examples.Comment: 52 pages, 11 figures, for freely available MATLAB software, see http://www.cis.jhu.edu/~goutsias/CSS%20lab/software.htm

Altered Topological Properties of Grey Matter Structural Covariance Networks in Complete Thoracic Spinal Cord Injury Patients: A Graph Theoretical Network Analysis

Purpose. This study is aimed at investigating brain structural changes and structural network properties in complete spinal cord injury (SCI) patients, as well as their relationship with clinical variables. Materials and Methods. Structural MRI of brain was acquired in 24 complete thoracic SCI patients (38.50±11.19 years, 22 males) within the first postinjury year, while 26 age- and gender-matched healthy participants (38.38±10.63 years, 24 males) were enrolled as control. The voxel-based morphometry (VBM) approach and graph theoretical network analysis based on cross-subject grey matter volume- (GMV-) based structural covariance networks (SCNs) were conducted to investigate the impact of SCI on brain structure. Partial correlation analysis was performed to explore the relationship between the GMV of structurally changed brain regions and SCI patients’ clinical variables, including injury duration, injury level, Visual Analog Scale (VAS), American Spinal Injury Association Impairment Scale (AIS), International Classification of Functioning, Disability and Health (ICF) scale, Self-rating Depression Scale (SDS), and Self-rating Anxiety Scale (SAS), after removing the effects of age and gender. Results. Compared with healthy controls, SCI patients showed higher SDS score (t=4.392 and p0.05). Conclusions. SCI patients would experience depressive and/or anxious feelings at the early stage. Their GMV reduction mainly involved psychology-cognition related rather than sensorimotor brain regions. The efficiency of regional information transmission in psychology-cognition regions increased. Greater GMV reduction in psychology region was related with more severe depressive feelings. Therefore, early neuropsychological intervention is suggested to prevent psychological and cognitive dysfunction as well as irreversible brain structure damage